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ABSTRACT 

The objective of this study was to evaluate the 
impact of the CO-Plus project by organizing data to utilize the 
classroom as the basic unit of analysis. The study employed classroom 
observations^ a variety of questionnaire responses from staff and 
pupils, achievement test scores, and related data. Questionnaire data 
were summarized using factor analysis and relationships between 
observations. Questionnaire responses were identified using multiple 
regression and canonical correlation. The analysis indicated that 
significant relationships exist between classroom behavior, staff and 
pupil attitudes, and achievement test gains and that the utilization 
of the classroom as the basic unit strengthens the analysis. 
(Author) 
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Classroom by Classroom Analysis of the 
Imp act of a Compensatory Education Program 

I ntroduction 

The Cooperatively PI anned Urban School Program (CO*"PLUS Program) is 
an experimental project funded through Model Cities, administered by 
the Chicago Board of Education and intended to offer a saturation of 
services to each of seven inner city schools. As originally conceived 

the program included nine separate projects: 

- the New Careeis Project designed to provide para- 
profess i'onal support in the classroom through the 
employment of residents of local Model Cities Target 
Area, and to provide career counseling and an 
academic program at both the high school and 
college level for these paraprof essionals , 

- the Instructional Team Leaders Project which pro- 
vided approximately ten team leaders for each school 
to support the school instructional program, work 
with the school inservice program and coordinate the 
activities of the parent-team grade level planning 
groups (see below)^ 

- The Audio- visual Equipment and Ins true t ion al Materials 
Project, which provided special ins true tional equipment 
and materials to the schools in addition to those 
regularly provided by the Board of Education, 

- the Inservice Training Project which provided paid 
inservice for teachers in the seven CO-PLUS schools, 



the Parent-Team Grade Level Planning Project intended 
to establish a functioning advisory team, including 
parents, teachers, team leaders and classroom aides, 
for each grade level in each CO-PLUS school , 

the Preschool Project which provided a preschool 
instructional program for approximately 800 three and 
four year olds in seven specially constructed schome 
(school-home) buildings, and which provided a homemaking 
program for parents of children attending the schome > 

the Community Schools Project which provided an evening 
program for parents and other Target Area residents. 



and tutorial and recreational program^ for the students 



o{ the CO-PLUS school, 

the Nutritional and Health Project intended ^-o provide 
medical and dental examinations for every student and 
to provide the opportunity for free breakfast and lunch 
at school, and 

the Administration Project intended to provide planning, 
evaluation, and coordination support for the total CO-PLUS 
Program. 



Almost from its inception the CO-PLUS Program was beset with financial 
difficulties and uncertainties which significantly limited the imple- 
mentation of the projects. For example, when the austerity programs 
were in effect, it was impo£?sible to hire new personnel, replace 
existing personnel who resii;ned, or expend many allocated funds 




without explicit approval on a case by case basis. This is mentioned 
because it had a definite psychological impact on the project personnel 
and may have influenced the data gathered by the research team* 

In the second action year the projects were reorganized so that each 
school had its separate instructional project which included elements 
of the Instructional Team Leader, Parent-Team Grade Level Planning, 
and the Tnservice Projects. Throughout the three years of operation 
of the CO -PLUS Program the schools were encouraged to develop their 
school instructional program and other school services in the way 
which uniquely benefited their students, parents and community* 

The data presented in this report were gathered during the 1971-72 
school year, and were intended to reflect on the component projects 
of this program. 
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Ins t rumen ts 

It was the responsibility of the research and evaluation team to 
identify, collect, analyze and report data which accurately reflect- 
ed the effectiveness of these projects in t.eeting their stated ob- 
j ec ti ves . 

To fulfill this responsibility, the research team developed and 
utilized a variety of data collection instruments: 

- questionnaires were developed for teachers, team leaders, 
clas sjrooni ai des , p rincip als and admin is trative staff, and 
pupils to determine their response to specific elements in 
each* of the projects, 

- two observation instruments were developed, to analyze the 
activities of students and teachers and aides in the class- 
room and to determine, if possible, the impact of these pro- 
jects on classroom instruction, and 

- the Metropolitan Achievement Tests were administered to the 
CO-PLUS students on a pre-posttest basis the Fall of 1971 
and Spring of 1972. 

The analysis of these data was reported in a summary evaluation 
report to the Chicago Board of Education. This report renresents a 
s upplimentary analysis of some of the same data included in the 
summary report using the classroom as the basic unit of analysis . 

P rodedures 

During the 1971-72 school year the research staff visited each of 
the CO-PLUS classrooms and recorded their observations using the 
CO-PLUS Classroom Observational Record, a specially designed instru- 



ment which documents a variety of information separately for each 
of the instructional groups in the classroom including the group size, 
the group leader, the subject covered, the instructional materials 
utilized, the activity of the leader, and the apparent degree of 
attention of the students. In addition, a second observational 
instrument was used to focus on the behavior of students in the 
classroom. The C0-PLU3 Student Observational Record documents the 
degree to^which the students were involved in the following activi-- 
ties : 

- independent involment with instructional materials, 

- preparation for a new activity or changing from one activity 
to another, 

- interaction with peers, 

- interaction with the teacher^ 

- interaction with the classroom aide^^nl 

- teacher-directed group instruction. 

Each of these categories is subdivided into specific student activi-- 
ties to assist the rater in accurately classifying student behaviors. 
Each cycle on this instrument describes the number of students at 
that moment engaged in each of the various behavioral categories. 

The teacher, team leader classroom aide and administration question- 
naires were administrated during a special inservice session at 
each s chool during the las t two weeks of th3 school ye ar . The s t un- 
dent questionnaire was administered by teacher to students in the 
third through eight grades, durine fh-fc; same time ^eviod. 

The Me tropoli tan Achievement Tests were given to the students by 
their teachers in September, 1971 and again in June, 1972. 
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The data were organized by classroom for this analysis. Since 
a direct linh had to be established bet\;een the data source 
and the clascroon, the scope of the study V7as limited to the 
f ollov/ing: 

- the CO-PLUS Student Observational Record, 

- the CO-PLUS Class Observational Record, 

- the CO-PLUS Student Questionnaire, 

- the CO-PLUS Teacher questionnaire, and 

- the Metropolitan Achievement Tests. 

To maintain parsimony, both the teacher and student- 
questionnaires v;ere factor analyzed. As shov.m in Ficjures 1 and 
2, seven factors v/ere identified for the student questionnaire 
v;hile 15 factors v/ere identified for the teachers. For the 
analysis, the weights determined in the innti?3l factor anaJysi? 
v;ere used to calculate factor scores for each classroom. 

Similarly, the CO-PLUS Student and Class Observational 
Records v/cre summarized in terns of the percent of pupils and/or 
teachers enraged in each activity. Figures 3 and 4 contain a 
description of the ways in v;hich the Observational Records v;ere 
summarized. 

The test scores for the pupils were summarized as shown 
in Figure 5 to reflect the pre-posttest gains on each subtest 
and the percent gain in the ratio of ric^hts to items attempted 
betv;een-the pre and posttest. 
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FIGURE 1 



FACTORS INDENTIFIED FOR THE 
CO-PLUS STUDENT QUESTIONNAIRE 



Label 


Directionality 


Des crip tion 


CSQl 


+ 


Positive attitude toward the 
provisions of the CO-PLUS 
Program 


CSQ2 


+ 


Negative attitude toward spe- 
cific elements of the CO-PLUS 
Program 


CSQ3 


+ 


General verbal factor con- 
cerning feelings about achool 


CSQ4 


Revers ed 


Perceived parental support for 
the teacher and school 


CSQ5 


Revers ed 


Dislike for school 


CSQ6 


Reversed 


Dislike for nutr/tional p ^^ram 


CSQ7 


Revers ed 


Percei.ved support for hom^ jrk 
from parents and classroom aide 
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FIGURE 2 



FACTORS INDENTIFIED FOR THE 
CO-PLUS TEACHER QUESTIONNAIRE 



Label 


Directionality 


Description 


CTQl 


+ 


Attitude toward*the Parent- 
Team Project 


CTQ2 


+ 


Attitude toward the Inservice 
P ro j ec t 


CTQ3 


+ 


Attitude toward the Classroom 
aide 


CTQ4 

- 


+ 


Reported utilization of inser- 
vice information in the class- 
room 


CTQ5 


+ 


Attitude toward the use of vi- 
sual equipment in the classroom 


CTQ6 


Re ve rs ed 


Attitude toward the use of 
audio equipment in the class- 
room 


CTQ7 


+ 


Male-Female orient'Lfiox 


CTQ 8 


+ 


Attitude toward the value of 
teaching machines 


CTQ9 


Reversed 


Experience 


CTQ 10 


+ 


Reported support and guidance 
for classroom aide 


CTQ 11 


+ 


Negative attitude toward the 
role of the Instructional Team 
Leader 


CTQ 12 


+ 


At ti tude toward the Audio-vis ual 
and Instructional Materials Projec 


CTQ 13 




Negative attitude toward the In- 
structional Team Leader and Com- 
munity School Projects 


CTQ 14 


+ 


Negative attitude toward the role 

of parents and Instructional Team 

Leaders in the school authority 
s tructure 


CTQ 15 


+ 


Attitude toward the use of filns 
and TV in the class room 
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FIGURE 3 

DESCRIPTIVE DATA 
CO-PLUS STUDENT OBSERVATIONAL RECORD 



Code 


Description 


CSORl 


Preparing for a new activity or 
changing from one activity to another 


CS0R2 


Interaction with peers 


CS0R3 


Interaction with the teacher 


CS0R4 


Interaction with the classroom aide 


CS0R5 


Teacher-^directed group instruction 



FIGURE 4 



DESCRIPTIVE DATA 
CO PLUS CLASSROOM OBSERVATIONAL RECORD 



Code 


Des crip ti on 


CCORl 




Average ins tr "actional group size 


CC0R2 




Percent of student directed in- 
struction 


CC0R3 




Percent of instruction in reading 
and language arts 


CC0R4 




Percent of instruction involving 
the use of textbooks 


CC0R5 




Percent of instruction invo]v>.ng 
the use of instructional materials 
other than textbook 




Percent 


of Teacher Activities dire:ted towards: 


CC0R6 




Clerical tasks 


CC0R7 




- individually prescribed activities 
for s t udents 


CC0R8 




- group activities 






- activities involving the entire class 


CCORIO 




- con f erence activities 




Percent 


of Students involved in: 


CCORl 1 




- individually prescribed activities 


CC0R12 




- group activities 


CCORl 3 




- activities involi^ing the entire class 


CCORU 




- con ference ac tivi ties 


CC0R15 




Percent of students attending to 
ins truct ion 
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FIGURE 5 

TEST SCORES INCLUDED IN THE ANALYSIS 



Code 



Des crip tion 



PCTR 
PCTM 

TESTl 
TEST2 
TEST3 
TEST4 
TESTS 
TEST6 
TEST7 
TESTS 
TEST9 



Gain in the percent right of attempts on: 

- the three heading subtests 

- the three mathematics subtests 

Gain in the publisher's standard score units on: 

- the Word Knowledge s ub tes t ( Vocab ulary) 

- the Word Analysis subtest (Word Attach Skills) 
th e R^eading sub tes t (Comp rehens ion) 

- the Language Arts subtest 

- the Spelling subtest 

- the Mathematics Computation subtest 

- the Mathematics Concepts subtest 

- the Mathematics Problem Solving subtest 

- the Total Reading Score 



ERLC 
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Finally, three additional covariables v/ere used in the 
analysis : 

- grade level (grade) , 

- the ratio of students v/ith pre and posttests, to all 
students vjho tool: a pretest and/or posttest {FCT STB), 
and 

- the percent of students v/hose native language is not 
English (PCT TESL) . 
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Results 

As indicated in Ficurc 6, there was a significant ra-n on 
all the subtests, and in the percent of itens students ansv/cred 
of those attempted, j..e. cuessing probably decreased on the 
posttest. As sho\:n by the neans for the observational scales 
(all means are inflated by a factor of 10), over 50% of all 
instruction received by pupils involved the class as a whole, 
V7hile approxiraatcly 1S% of the instruction observed was classified 
as individual involvcr.ent v/ith materials. These ficures acreo 
V7ith past analyses of the instruction provided in this procraia. 
Finally, it is worth noting that approximately 30% of the 
students were lost over the period betv:een the pretest 
and posttest, indicating the generally high level of transiency 
characteristic of these schools. 

Figure 7 indicates the factor analysis between the Student 
Observation Record and the test score gains. 

As these data indicate, although there were six significant 
factors, there was little interplay between the test scores and 
observations. Factor 1 appeared to be related to reading 
achicvenient, Factoz 2 to natheinatics achievement. Factor 3 to 
individualized instruction. Factor 4 to the gain in percent 
right of those attempted. A significant ancillary finding was 
the moderate correlation (r.=21) between the percent stability and 
the achievement gain of pupils on the mathematics concepts subtest. 

Figure 8 indicates the factor analysis betv;een the factors 
of the Student Questionnaire and the test scores. As in 



FIGURE 6 



IIEAITS AlTD STMTDhRU DUVIAVIQ-S 
CO-PLUS STUDEITT 03££RV:.TI01:AL R-COHD AaD TCST SCCR2 GAINS 



MEANS AND STANDARD DEVIATIONS 



VARIABLE 

PCTR 
PCTM 

TEST 1 
TEST2 
TEST3 

TESTS 
TEST6 
TEST7 
TESTS 
TEST9 

PCT STB^ 

PCT TESL^ 
CSO'Rl 
CS0R2 
CS0R3 
CS0R4 

CS0R5 
CS0R6 



MEAN 

21t3086 
18,3519 
6 #4406 
6.3969 

8.3572 
2t5706 
5.2311 

10.5488 
4.7214 
4,1072 
6t8164 
4.0988 

69.8889 
2.4012 
183.5617 
112.09B8 

87.8827 

54.0926 

38.9012 
520.5247 



STO OEV 

24.9629 
27.4931 
4.5643 
4.3806 
4.4090 
4.9891 

5.2894 
5.8955 
5.0012 
6.0942 

• V/T 

2.3278 
15.2788 

6.6524 
250.9760 
112.4680 
113.7296 
118.5731 

79.7280 
340.1893 



ERIC 
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FIGURE ? 

FACTOR ANALYSIS FOR TFE STUDBIIT 0I3SKRVATI0::S 

AHD TEST SCORES 



VARIMAX ROTATION 



1 2 3 4 5 6 

PERCENT OF VARIANCE 
18.862 13.495 10.208 9,430 7.405 6,476 



ROTATED FACTOR LOADINGS' 



PCTR 
PCTM 




,380 




.340 


.030 




.605 


-.121 


-.025 




,087 




.079 


-.072 




.739 


-.033 


.045 


TESTl 




.852 




.098 


.006 




.030 


.137 


.055 


TEST2 




.771 




.146 


.112 




.020 


-.126 


-.008 


TEST3 




.879 




.012 


-.117 




.090 


.029 


-.089 


TESTA 




.087 




.4r»7 


.160 




.?15 


.433 


-♦229 


TESTS 




.025 




.821 


.022 


m 


.051 


.181 


.116 


TEST6 




.639 




.119 


.149 




.382 


-.242 


-.016 


TEST? 




.007 




.894 


.080 


m 


.121 


.069 


.003 


TESTS 




.069 




.040 


.019 


•• 


.032 


-.110 


-.054 


TEST9 




.858 


m 


.203 


-.024 




.021 


.109 


.0)7 






.476 




.182 


.158 




.613 


-.161 


.093 


PCT STB^ 




.199 




.147 


-.203 




.326 


.614 


.094 


POT TESL 




.097 




.119 


-.001 


M 


.077 


-.058 


-.803 


CSORl 




.079 




.080 


.825 




.119 


-.013 


-.087 


CS0R2 




.260 




.066 


.373 




.291 


-.449 


.181 


CS0R3 




.013 




.082 


.217 




.028 


.551 


.457 


CS0R4 




.035 




.068 


.318 




.010 


.398 


-.038 


CS0R5 




.118 




.234 


.140 




.397 


-.234 


.4R7 


CS0R6 




.071- 




.022 


-.949 




.097 


-.111 


-.250 



15 



the factor analysis above the loadincs tended to shift cither to 
the test scores or the questionnaire, but did not indicate a 
stronr relationship between then. This analysis confii:;:.ed a strong 
readinr achievo.v.ent factor, a generalized responsiveness to the 
questionnaire, a positive factor concerninc, appreciation for 
the CO-PLUS prorraiTi, the gain in percent right of those attempted 
and a r.atheniatics achievenent factor. These data validated the 
general reading and nathenatics achievement factors cited above. 

The fac^cor analysis for the Student Observational Instrument, 
the Student Questionnaire and the test score gains, indicated 
approximately the sane factor structure as above. 

Two additional interesting findings cap.e from the above 

•-tfc^-^w Ww-wCfcJ- CiXlCU.^^ OV^O • 

- grade was r.oderately but consistently negatively 
correlated v/ith reading gain {.2<r<'.4), and 

- the fifth factor score for the Student Questionnaire 
(the inverse of a general dislihe of school) ims 
consistently related to achievement in both reading 
and p.athep.atics. 

In summary, the above data suggest that, as has often been 
reported before, affective and observational information concerning 
students usually yielcteonly lov; and noderate correlation with 
the actual achievenent of those students, and often are not 
even correlated uith each other. In this situation, it appears 
that there v;as a definite factor structure for the attitudinal 
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FIGURE 0 



FACTOR ?.::ALYSIG -CO-PLUS STTOUrT QUESTIOITIJAIRS 

AID TBST SCORES 



VARIHAX ROTATION 

1 ■ 2 3 k 5 6 

PERCENT OF VARIANCE 



21 .952 13. 120 10. 179 10. 207 9.itC6 6. 327 

ROTATED FACTOR LOADINGS 



PCTR 
PCT^f 


.503 


. 262 


.190 


-.578 


.168 


. 070 


.318 


.112 


.052 


-.761 


. lO^^ 


.136 


TESTl 


-.890 


.^♦5 


-.ICS 


.076 


-.128 


.138 


TEST2 


-.717 


.235 


. 08G 


-.222 


-. I£i0 


-,Ckk 


TESTS 


-.889 


-.135 


-.158 


-. 30i^ 


-. It*! 


.038 


TESTA 


.067 


.007 


-.l^C 


. 265 


-.^♦69 


.095 


TESTS 


-.'♦68 


-.02i^ 


.079 


-.013 


-.fAO 


.172 


TEST6 


-.727 


r o o 

• u r. c 


• 1 JLU 


.313 


- . &98 


-.033 


TEST7 


-.'♦19 


-.201 




.116 


-. 715 


.129 


TESTS 


-.^♦26 


-.037 


.096 


-.111 


-.676 


-.151 


TEST9 


-.901 


-.076 


- . 1 5B 


. 065 


- . 138 


.099 


PCT STB^ 


.278 


-.239 


.0 29 


. 810 


-. C27 


'»um 


- .2i^5 


-.155 


-.051 


-.087 


.059 


, 786 


PCX TESL^ 


-.088 


-.152 


-.2'*7 


. 07 2 


.303 


-.683 


csqi 


-.078 


.786 


.062 


. J5i 


. 217 


.003 


CSQ2 


-.005 


.705 


-.515 


-.202 


' .111 


. Oi^6 


CSQ3 


-.221 


.533 


-,1*72 


.019 


. 161 


-.28i^ 


CSQ4 


-.02i^ 


.C28 


-.807 


.196 


. 117 




CSQ5 


.16i^ 


.563 


.280 




-. C17 


-.102 


CSQ6 


«068 


.120 


.832 


. 097 


. 200 


. 101 


CSQ7 


- .075 


-.8i^5 


-.057 


- .309 


. ^♦3 


-.052 
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scores, obccrvcition ccorec, and test score rjains but these were 
only nominally correlated anong thenisolves. 

AS sho'.m in Figure 9, the factor analysis between t>.e 
Teacher Questionnaire and the test scores yielded a "definite 
factor structure for both sets of data, but again an independence 
betvrecn the sets of data. The first factor V7as a general response 
to the audio-visual and parent teara projects, the second the 
reading achievenent factor, the third a mathematics achievenent 
factor, the fourth a response to the inservice project, ;he 
fifth an openess to differentiated staffing and the sixth a 
resistance to the changing, authority patterns in the school. 
An intriguing sidelight to this analysis was the indication 
that the nale pole of CTQ7 was related to lov/er gains in the 
percent of iteir.s correct of those attenpted. This nay be due 
in part to the relationship betv;een the privileged role usually 
extended to male elementary school teachers, and the openess 
this transmits to students reducing their fear of failure. 

Figure 10 indicates the means ?nd standard deviations for 
the CO-PLUG Classroom Observational Record. These data indicate 
that the mean instructional group size was 12, that 
approximately 24% of all instruction v;as student self-directed, 
that approximately £4% of instruction involved the use of 
instructional materials beyond regular textbooks, that an 
average of approximately 407b of all instruction was directed 
tov.'ard groups of children \;hile an average of approximately 367^ 
of the instruction v/as directed toward the class as a v/hole, 
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FIGUnE 9 

FACTOR ANALYSIS OF THE CO-PLUS 
TEACHER QUESTIOlirAIRE Al-H) TEST SCORES 



VARIMAX RCTATICN 

12345678 

PERCENT CF VARIANCE 





13 


• 866 


12^094 


9 


• 796 


7 


.897 


8.943 


6.203 


4 


• 992 


4.830 








ROTATED 


F A O T*^ 
r AC 1 w 




LOADINGS 












TQl 




• 719 


• 014 




• 09b 




.430 


-.070 


-.092 




• 248 




• 028 


TO 2 




• A61 


• 132 




• 031 


_ 


.714 


• 060 


#013 




• 100 " 




• 0O3 


TO 3 




,344 


• 031 




• 007 




.276 


-.521 


-•067 




• ~ *^ ~ 




.011 


TQ4 




• 191 


• 042 




• 010 




.855 


.082 


-•013 




.012 




.126 


TQ5 




• 085 


• 116 




• 038 




• 182 


.283 


• 663 




.168 




.146 


TQ6 




.177 


-•004 




• 164 




• 095 


-.157 


-•175 




.805 




.026 


TQ7 


m 


• 181 


• 077 




• 162 




• 047 


-.657 


-•150 




.106 




.054 


TQ8 




• 787 


-•043 




• 109 




• 042 


-.663 


-•255 




.204 




.012 


TQ9 




• 111 


• 020 




• on 




• 132 


.093 


-•808 




.097 




.074 


TQIO 




• 395 


• 018 




• 003 




• 235 


-.677 


-•035 




.052 




.026 


TQll 




• 472 


• 063 


m 


.087 




.632 


-.180 


-.OBI 




.020 




.099 


TQ12 




• 873 


-•040 




• 029 




• 045 


-.066 


-•ll7 




.061 




.066 


TQl 3 




.547 


-•053 




• 063 


m 


• 156 


.259 


-.383 




.045 




.109 


TQ14 




.199 


.103 




• 056 




• 010 


-.513 


.527 




.344 




.106 


TQ15 




• 838 


• 039 




• 058 




• 066 


-.199 


-.015 




.048 




.007 


PCT STB^ 




• 249 


-•2^7 




• 252 




• 251 


-.037 


.085 




.341 




.307 


PCT TESL^ 




• 042 


• 0«4 




• 109 




• 182 


-.605 


.133 




.038 




.098 


PCTR 




.034 


.267 




• 421 




.037 


.372 


-.022 


mm 


.175 


m 


,373 


PCTM 




t076 


-.022 




• 120 




.016 


.206 


.139 




.033 




.784 


TESTl 




• 017 


-.893 




• 117 




• 008 


-.058 


-.077 




.044 




.167 


TEST2 




• 077 


-•736 




• 126 




• 160 


.312 


-•001 




.044 




.090 


TESTS 


m 


• 008 


-•800 


m 


• 107 




• 104 


• 053 


-•012 




.188 




.214 


TESTA 




• 106 


• 048 




• 446 


m 


• 092 


-•265 


• 078 




.208 




.099 


TESTS 




• 032 


• 032 




.873 




• 093 


• 059 


• 007 




.019 


m 


.046 


TEST6 


m 


• OlO 


-•638 




.087 




• 045 


• 230 


• 034 




.021 




.527 


TEST7 




• 079 


• 019 




.879 




• 041 


-•058 


.033 




.055 




.063 


TESTS 




• 129 


-•077 




.749 




• 058 


• 107 


-.058 




.112 




.009 


TEST9 




• 032 


-•899 




.189 




• 017 


-•105 


-.059 




.050 




.180 
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FIGIJP.E 10 



DSSC'P.IPTIVP. ST.'.TISTICS FOR THE 
CO-PLUS CL.'.SSROOIi OESUPAT'.TIOITAL RECOr.D 
AITD '•j?:!!: TEST SCCRDS 



MEANS AND STANDARD DEVIATIONS 



VAHIABLE 



MEAN 



STD DEV 



CCORl 
CC0R2 
CC0R3 
CC0R4 
CC0R5 
CC0R6 
CC0R7 
CC0R8 
CC0R9 
CCORIO 
CCORll 
CCORl 2 
CCORl 3 
CC0R14 
CC0R15 

PCT STB 
PCT TESL 
PCTR 
PCTM 
TEST 1 
TEST2 
TEST3 
TESTA 
TESTS 
TEST6 
TEST? 
TESTS 
TEST9 



1 



1 2J09 


9^4 58 


2-4.066 


3 0.954 


, 7.205 


1 H.690 


2 1.457 


3 1.911 


6 4,477 


3 4.904 


1 l.POl 


? .0.070 


1-0J75 


? 1.613 


3 


3 7.936 


2 4397 


3 3.073 


.0.212 


•1.761 


7.166 


1 ■9;^57 


4 2.934 


4 -2,790 


3 6,113 


4 3.B06 


0.330 


3J56 


9 1.642 


1 3,4 93 


70#25P3 


15^4528 


2c8013 


6,9513 


19,3245 


24^5^>76 


lH.9669 


25,5300 
4ol05B 


6»9H24 


6*9407 


3.9889 


8«4315 


4.4182 


5»8973 


5»6693 


6«0lRl 


4.2235 


10a9l51 


6.0235 


7,3865 


4,3029 


6«3196 


5*2047 


7#2966 


3*6H05 
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FIGURE 11 



F7.CTC?. :.::aj..ysis ?cr th?: 
co-PLU£ CLj>.S£Roo:; OBSE?>v.vrior:.L record 

WITH TEST SCORES 





1 


5 








14.137 


8.319 


CCORl 






30fi 


CC0R2 


• cA? 


• lA 1 




CC0R3 


• 13H 






CC0R4 






• « * U T 


CC0R5 




• vJC 1 




CC0R6 




# c f» 


• J C. 7 


CC0R7 




• O " 1 


Q 1*2 


CCORS 




# w «^ T 


• «- ^ i 


CC0R9 


-.OK' 


-.87r. 




CCORIO 


.oiv 


.O^H 


.035 


CCORll 


~.o^^ 


.04] 


.9^2 


CC0R12 


-.082 


.897 


-.217 


CC0R13 




-.885 


-.1^5 


CC0R14 


-.f>05 


.020 


.013 


CC0R15 


.039 


.071 


.045 


PCX STB^ 


.121 


.066 


-.146 


PCX XESL^ 


.103 


-.049 


.038 


PCXR 


-.20H 


• 076 


-.Cib 


PCTM 


.nH5 


.034 


. 003 


XESX 1 


.931 


-.C'^.7 


-.04o 


XEST2 


.ab2 


• 0(^1 


.039 


XESX3 


.866 


-♦02n 


-•002 


TEST4 


.616 


-.2flo 


.12b 


XESX5 


.576 


.074 


.055 


'TEST6 


.734 


-•063 


-.027 


TEST? 


.612 


.079 


-.100 


XEST8 


.541 


-.099 


-.C2ij 


XEST9 


.957 


-.069 


-.037 



7. 138 6.432 



-.002 
"•020 
-.027 
-.055 
-.053 
-.047 

.094 
-.019 
-.056 

.9H0 
-.030 

-.Oil 
-.064 
.984 
.026 

• 033 
-.015 
-•n74 

• 023 

• 004 

• 1^0 
-•053 

• 064 

-•000 
-•036 

-•056 
-.058 

-•001 



-.052 
-.693 
-.644 
-.939 
.028 

-.01 1 
.933 

-.039 
.068 
.006 
.622 

.roc 
-.006 

-.003 
.602 

-.117 
.056 
.025 

-.030 

-.020 
.028 

• 066 

• 052 

• 630 
-•006 

•6o7 

-.699 
-.010 



VARIMAX PCTATICN 
6 7 8 9 10 

PFPCEMT CF VARIANCE 
7.054 5.222 5.339 4.383 4.7?5 
WCTATED FACTOR LOAPINRS 



. 0?7 


• • V U 


. i U ' 




. 093 


-•072 


• 0!4 


-.267 


•lOO 


.09? 


• 061 


.920 


.052 


-•072 


-.071 


• COl 


-.165 


.093 


• 017 


.093 


.039 


-.206 


.116 


• 082 


-.011 


.119 


.061 


-.682 


.384 


. 126 


• C04 


-.027 


.140 


.00? 


-.088 


-.081 


-.205 


.231 


-.053 


.097 


.C2B 


-.145 


.142 


-.023 


-.052 


.016 


-.012 


.022 


-.022 


.024 


.086 


.009 


.06^ 


-.035 


'-.079 


-.025 


-.219 


.158 


.002 


.0*17 


.018 


-.173 


-.015 


.108 


.027 


.028 


-.003 


.033 


-.004 


.023 


.090 


.074 


.836 


.167 


.051 


-.015 


-.078 


-.018 


-.131 


.861 


.012 


-.063 


-.008 


.877 


-.107 


-.61ft 


.231 


.238 


• 301 


-.003 


-.896 


-.151 


-.129 


-.184 


.139 


.033 


.080 


.006 


.061 


.059 


-.039 


.179 


.001 


• 120 


.077 


• 007 


-.020 


.015 


• 044 


.181 


• 631 


-.017 


-.013 


• 059 


.073 


• 566 


.113 


.122 


-•072 


• 191 


• 078 


.078 


-.034 


-•014 


-.314 


• 289 


-.310 


.063 


-•200 


-.364 


• 116 


-.388 


.069 


-•109 


-.381 


• 023 


-.062 


-.021 


• 003 


.067 



ERIC 



21 



and, finally, appro::ir.atcly 90^: of the tJtudentc observed appeared 
tc be attentive to the instruction they were receivincj. 

The factor analysis, sunmarized in Fic;ure 11, indicated a 
pattern sinilar to those cited above. Factor 1 v.'as a rendinc; 
achicvenent factor, Factor 2 reflected the decree to ^.'hich rroupinc 
was erroloyed rather than instruction to the class as a v;hole. 
Factor 3 indicated the extent of individual instruction for 
student, Factor 4 assessed the emphasis on conference activities 
for students. Factor 5 indicated the use of instructional materials 
beyond te::tboohs, and Factor 6 reflected the gain in percent 
right of test items attempted. 

Picture 12 documents the factor analysis of the tv;o 

t... — >->">— ^ »- tiCcj-ii 2r -^Sj-uc'^^ u t*imixar 

factor structure to those indicated above v;hen each was examined 
separately with the test scores. Similar results v;erc found 
when the Teacher Questionnaire was added to the analysis. 

In summary, there v;as a consistent pattern throughout the 
analyses reported here that: 

- each of the instruments used in the evaluation had a 
fixed internal factor strucr.ure, . nd 

- there vjas no overlap betv;een factor structures, i.e. 
they v;ere independent and uncorrelated. 
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r:.CTo:. A:.:;Ly<jin - co^r-r,^:^ ei.:.ss; cbg-vatto-.l ".-c-d 
ai:d co-PLur> stulv;:.t C3i-j-VATic::.AL hEcoRD ' 



CCORl 

CCbR2 

CC0R3 

CC0R4 

CC0R5 

CC0R6 

CC0R7 

CC0R8 

CG0R9 

CCORIO 

CCORl 1 

CCORl 2 

CC0R13 

CC0R14 

CC0R15 

CSORI 

CS0R2 

CS0R3 

CS0R4 

CS0R5 

CS0R6 



^^3^ 5 6 7 8 

^'ERCrMT OF VARIANCE 
17.49C „....?« ,„.„33 8,351 6.637 6.7S6 5.405 

ROTATf.n FACTOR LOADINGS 



" • 6o4 
.332 

-.021 
.CIB 

-.024 

-.lb2 
.039 

• Bifli 
-.8f)5 

.019 
.892 

-.873 
.0'''6 

• CSfi 
-.094 
-.005 

.055 
.1^7 
-.052 
.012 



-.361 
.5?.3 
• 0^^ 
-.028 
.«n8 
-.0^5 
.«»45 
-.276 
-.2f)6 
.•?17 
.934 
-.196 
-.2S8 
.013 
.078 
.n^2 
-.051 
.OTT 
.029 
-.148 
-.017 



-.109 


-.005 


.052 


.144 


.007 


.051 


-.0')4 


-.024 


.090 


.0«»3 


.047 


.918 


-.cu» 


.064 


-.898 


-.0o2 


.015 


-.011 


.O'+O 


-.081 


-.r>46 


.Ola 


.018 


.031 


.063 


.f)66 


-.f5y 


.OoH 


-.9lf, 


-.005 


. 00 J 


.026 


-.044 


- . 003 


.001 


.023 


.Ob 9 


.075 


-.^18 


.0^6 


-. 43 


-.001 


-.107 


-.C .9 


-.016 


.726 


-.012 


-.076 


.155 


.046 


-•002 


.521 


-.316 


.087 


.44n 


.07Q 


.217 


.302 


.068 


-. 148 


-.966 


.040 


-.011 



.026 


.219 


-.060 


-.064 


.081 


.199 


.d63 


.059 


.055 


-.1«3 


-.092 


.046 


-.3-^2 


-.114 


.030 


.144 


.753 


.011 


-.023 


-.140 


-.075 


-.238 


-.253 


.036 


-.176 


-.143 


.016 


.075 


-.038 


-.005 


.027 


-.097 


-.070 


-.266 


-.1**9 


-.006 


-.194 


-.017 


.0«6 


-.041 


-.045 


-.007 


.117 


-.742 


.073 


.142 


-.005 


.111 


.032 


-.098 


.895 


-.175 


.134 


-.104 


-.209 


.038 


-.245 


.419 


-.226 


-.367 


-.096 


.040 


-.206 
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ConcliinioriG 

The results of this analysis, especially in viev; of the 
cost in both stoJTi: and cor.puter tir^e, v;ere disappointinc , 
Althouch each of t:)eoc instrv.:r.cnts \;as developed and adninistercd 
independently of the others, it v?as hoped fron a research point 
of viev: that significant relationships could be uncovered 
bot\7een then. On the basis of the statistical analyses reported 
above it appears t:iat: 

- the inGti*i2nents are internally consistent, measuring 
definite attitu.des and behaviors, and 

- these attitudes and bch.avior:; appear to be independent 
of achievement test scores and independent of each 
other. 

Fron: the point of viev; of the evaluation, hov;ever, this 
is not necessarily a bad situation, since the evaluation 
procedure is not made less efficient vhen tiicro is no overlap 
betv;ean data sources. Thus, it appears thc\t the data, Irase used 
in this analysis v;as sufficient to fulfill the evaluation 
function, but insufficient to fulfill the desired research 
function 



Inquiries concerning this paper, or the instruments ciLed 
in it can be addressed to: 
Fred r^rster 

Director of !:odel Cities Research and Evaluation 
The Chicaco Board of Education 
220 N. LaSalle Street (Rood 617) 
Chicaro, Illinois 60601 



